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DISTRIBUTED CONTROL SYSTEM WITH GLOBAL CONSTRAINTS 
FOR CONTROLLING OBJECT MOTION WITH SMART MATTER 

CROSS-REFERENCE TO RELATED APPLICATIONS 

^^ross-reference is made/fo the following U.S. Patent Applications, each of 
5 which is assigned to the safne assignee as the present invention and hereby 
incorporated by referenjre: Serial No. 08/AAA,AAA, entitled "Multi-Hierarchical 
Control System For/Controlling Object Motion With Smart Matter" (Attorney 
Docket No. D/98d90); Serial No. 08/BBB,BBB, entitled "Market-Based Control 
System For Controlling Object Motion With Smart Matter" (Attorney Docket No. 
10 D/98091)/and Serial No. 08/CCC,CCC, entitled "Adaptive Multiagent Control 
Systerpi For Controlling Object Motion With Smart Matter" (Attorney Docket No. 
D/99092). 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

15 The present invention relates generally to a method and apparatus for 

controlling microelectromechanical systems (MEMS), and more particularly, to a 
control system having a global controller and local agents for controlling 
movement of an object on a transport assembly. 

2. Description of Related Art 

20 Smart matter is defined herein as a physical system or material with 

arrays of microelectromechanical devices embedded therein for detecting and 
adjusting to changes in their environment. For example, smart matter can be 
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used to move sheets of paper in a printing machine or maneuver an aircraft by 
performing tiny adjustments to wing surfaces. Generally, each 
microelectromechanical device embedded in smart matter contains microscopic 
sensors, actuators, and controllers. A characteristic of smart matter is that the 
5 physical system consists large numbers (possibly thousands) of 
microelectromechanical devices. These devices work together to deliver a 
desired higher level function (e.g., moving a piece of paper from one location to 
another, or flying a plane). 

Programs for controlling smart matter do not always adequately achieve 
10 the desired higher level function of issuing command to compensate for detected 
changes in a physical system because of the significant number of devices that 
operate in parallel to control it. That is, there exists a number of factors which 
make the computational task of a control program for smart matter difficult. One 
factor which may be cause control programs to be computationally intense is 
15 caused by the high redundancy of sensors and actuators in the physical material. 
In order for smart matter systems to exhibit the enhanced reliability and 
robustness over conventional systems, smart matter systems contain many more 
devices than necessary to achieve a desired performance. Failure or improper 
function of some elements, even a significant fraction, is compensated by the 
20 actions of the redundant components. Moreover, the ability of smart matter 
systems to tolerate component failure can be used beneficially to lower the 
fabrication cost of the components. 
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One approach for controlling smart matter is to rely on a single global 
processor coupled with rapid access to the full state of the system and detailed 
knowledge of system behavior. This method, however, is generally ineffective 
because of the large number of devices embedded in smart matter. Another 

5 approach for controlling smart matter is through the use of a collection of 
autonomous computational agents (or elements) that use sensor information to 
determine appropriate actuator forces. Using multiple computational agents to 
provide distributed control instead of centralized control may prove more 
effective because each computational agent is only concerned with limited 

10 aspects of the overall control problem. In some multi-agent systems, individual 
agents are associated with a specific sensor or actuator embedded in the 
physical system. This method for controlling smart matter defines a community 
of computational agents which, in their interactions, strategies, and competition 
for resources, resembles natural ecosystems. Furthermore, by distributing 

15 control among computational agents, the system as a whole is better able to 
adapt to environmental changes or disturbances because the system can 
compensate for new circumstances by simply changing the relationship of the 
agents. 

Although multi-agent control systems have been used to solve distributed 
20 control problems, they have been limited to systems which are physically large or 
geographically scattered. For example, multi-agent systems have been used in 
distributed traffic control, flexible manufacturing, robotic system design, and self- 
assembly structures. Using multi-agent systems to control smart matter is 
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different from these known multi-agent systems because of the tight coupling 
between computational agents and their embedded physical space. 
Furthermore, controlling smart matter using traditional multi-agent systems is 
difficult because of mechanical interactions that decrease in strength with the 
5 physical distance between them. This makes the computational problem difficult 
because interactions between computational agents cannot be ignored. 

In defining a multi-agent control systems for controlling smart matter, 
there exits a need to identify a distributed control organization with agents that 
interact locally while robustly performing a global goal that is specified using 

10 global constraints on the system. It would, therefore, be desirable to provide a 
control system for controlling smart matter that is capable of rapidly responding 
to local perturbations while robustly satisfying the global goal. In addition, it 
would be desirable to provide a controller for smart matter that robustly 
coordinates a physically distributed real-time response with many devices in the 

15 face of failures, delays, changing environmental conditions, and incomplete 
models of system behavior. 

SUMMARY OF THE INVENTION 

In accordance with the invention there is provided a transport assembly, 
and method therefor, for moving an object. Sensor units and actuator units are 
20 arranged on the transport assembly. The sensor units provide positional 
information of the object. The actuator units move the object relative to the 
transport assembly. Local computational agents are coupled the sensor units 
and the actuator units. Each of the computational agents accumulates sensor 
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information from a spatially localized grouping of sensor units. A global 
controller, coupled to the local computational agents, receives aggregate 
operating characteristics from, and delivers global constraints to, the local 
computational agents. The local computational agents use the global constraints 
5 and the sensor information to determine adjustments to the actuator units to 
move the object along the transport assembly. 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other aspects of the invention will become apparent from the 
following description read in conjunction with the accompanying drawings 
10 wherein the same reference numerals have been applied to like parts and in 
which: 

Figure 1 illustrates a smart matter transport assembly for carrying out the 
present invention; 

Figure 2 illustrates a portion of the lower section of the transport assembly 
15 shown in Figure 1; 

Figure 3 illustrates two different types of air jets that are embedded in the 
transport assembly shown in Figure 1 ; 

Figure 4 illustrates one manner in which directional forces from air jets are 
applied to the object to control its movement along the transport assembly; 

20 Figure 5 illustrates a side view of an air jet, a sensor, and a controller as 

seen along view line 2-2 in Figure 2; 
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Figure 6 illustrates a detailed block diagram of the controller shown in 

Figure 2; 

Figure 7 is a flow diagram which sets forth the steps performed by an 
agent during a local operating time interval; 

5 Figure 8 illustrates an example of how the localized neighborhood of 

agents compensate for a perturbation in the object independent from the global 
controller; 

Figure 9 illustrates an example in which agents compensate for 
malfunctioning actuators in a localized neighborhood; and 

10 Figure 10 illustrates a lookup table for implementing the potential field 

shown in Figure 6. 

DETAILED DESCRIPTION 

A. Transport Assembly 

Referring now to the drawings where the showings are for the purpose of 
15 describing the invention and not for limiting same, Figure 1 illustrates a transport 
assembly 100. The transport assembly 100, which is used to transport objects 
102 in the process direction 112, is divided up into an upper section 104 and a 
lower section 106. For illustrative purposes part of the upper section 104 is cut 
away. Advantageously, the transport assembly 100 can transport a number of 
20 different types of materials such as paper, plastics, glass, foils, fabrics, uncured 
rubber and wafers. The sections 104 and 106 are sufficiently spaced apart to 
define a spacing 1 10 in which the object can travel along the transport assembly 
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without contacting either the upper or lower sections 104 and 106. Embedded in 
both the upper and lower sections 104 and 106 are arrays of spatially fixed 
microelectromechanical devices 108 (MEMS) that dynamically support, move, 
and guide the objects 102 through the transport assembly 100. It will be 
understood by those skilled in the art that depending on the size, weight and 
flexibility of the object being transported and the speed and accuracy in which 
the object is required to be transported, the transport assembly may consist of 
only one of the upper section 104 or the lower section 106. 

Figure 2 illustrates a portion of the lower section 106 of the transport 
assembly 100 shown in Figure 1. More specifically, Figure 2 illustrates a number 
of microelectromechanical devices 108 that consist of combinations of actuators 
202, sensors 203, and controller(s) 230. In one embodiment, the actuators, 
sensors, and controller are fabricated together on a single silicon wafer. In 
another embodiment shown in Figure 2, the sensors and actuators are fabricated 
in a housing separate from the controller 230. In the embodiment shown in 
Figure 2, the actuators 202 are air jet actuators that include two or more 
channels 204. In another embodiment not shown the actuators 202 engage a 
mechanical drive coupled to rollers for transporting flexible objects such as 
paper. 

More specifically in Figure 2, the arrows indicated by reference number 
206 illustrate the general movement of air exiting and entering the air jet 
channels 204. At least one of the channels of an air jet allows the exit of flowing 
air and the other of the channels the entrance of flowing air. It will be appreciated 



Express M| 



# 



|o. EG365635536US 



Patent Application 
Attorney Docket No. D/98093 



by those skilled in the art, however, that the air jet actuators may consist of a 
single channel which allows only the exit of air. A low-pressure plenum 214 is 
separated from high-pressure plenum 210 by a partition 216. The difference in 
pressure between low-pressure plenum 214 and high-pressure plenum 210 
5 permits air to flow from one channel to another. For example, a valve 208 can be 
selectively operated to permit high-pressure air in plenum 210 to flow upward at 
an angle as indicated by arrows 220, to impart momentum to objects 102 on the 
transport assembly, and pass downward through valve 212 into plenum 214 as 
indicated by arrows 222. 

10 Figure 3 illustrates examples of two different types of air jet actuators 202 

that are embedded in transport assembly shown in Figure 1 . As set forth above, 
the transport assembly 100 is divided into upper and lower sections 104 and 106 
with the spacing or passageway 110 therebetween. A first type of air jet is 
indicated by reference numbers 306 and 308 and a second type of air jet by 



15 reference numbers 310 and 312. The two types of air jet actuators have valves 
302 for releasing air from high-pressure plenum 212 and valves 304 receiving air 
into low-pressure plenum 214. The flow of air in Figure 3 is indicated generally 
by arrows 206. Depending on the direction in which the air jet actuators 306 and 
308 are positioned, air released therefrom will urge the object 102 in a selected 

20 process direction 1 1 2 and speed by adjusting the amount of air released onto 
either side of the object 102. In contrast, the air jet actuators 310 and 312 can be 
used to support the object 102 by applying an opposing vertically directed air 
flow as indicted by arrows from valves 302. 
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It will be appreciated by those skilled in the art that the first type of air jet 
actuators 306 and 308 may be positioned so that they exert a force opposite to 
that shown in the Figures in order to impart momentum to stop the object from 
moving in the process direction 112. In addition, it will be appreciated by those 

5 skilled in the art that two sets of the first type of air jet actuators 306 and 308 
may be oriented to apply forces to rotate the object. For example, the object 
may be rotated by having a first set of air jet actuator, located on one side of the 
object, push in the process direction, while having a second set of air jet 
actuator, located on the other side of the object, push in a direction opposite to 

10 the process direction so that the combined effect of the two air jet actuators is to 
apply a torque to the object. 

Figure 4 illustrates one manner in which directional forces from air jet 
actuators 202 are applied to the object 102 to control its movement along 
transport assembly 100 in the process direction 112. Longitudinal forces, 

15 indicated by arrows 404, are applied to cause the object to move in the process 
direction 112. Lateral forces, indicated by arrows 406, are applied perpendicular 
to the direction of motion to stabilize the object 102. Vertical forces, not shown, 
help maintain the object 102 between the upper and lower sections 104 and 106 
of the transport assembly 100. In Figure 4, the relative strength of the forces 404 

20 and 406 applied to the object 102 are illustrated by the length of the arrows 404 
and 406. It will be appreciated by those skilled in the art that the accelerations 
resulting from these vertical, lateral, and longitudinal forces applied to an object 
will vary depending on the type of material and size of the object. Thus, for 
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example, paper which is lighter and more flexible than glass may require smaller 
longitudinal forces but greater lateral forces to stabilize it on transport assembly 
1 00 than a more rigid object such as glass. 

Figure 5 illustrates a side view of an air jet 202, sensor 203, and controller 
5 230 as seen along view line 2-2 in Figure 2. In the embodiment shown in Figure 
5, the air jet 202 is a piezoelectric flap valve. The flap valve is electrically 
controlled through lead 508 by controller 230 to be either in a closed position, 
indicated by reference number 504 (solid lines), or an open position, indicated by 
reference number 506 (dotted lines). The air jet 202 includes a housing 514 
10 positioned in an aperture of the surface of lower section 106. In Figure 5 the air 
moves inward because it is coupled to low-pressure plenum 214 as indicated by 
arrow 206. The pressure in the plenum is maintained by air pressure source 512. 
Sensor information from sensor 203 is received through lead 510 by controller 
230. The sensor 203 in one embodiment is an optical sensor that is sufficiently 
15 accurate and quick to detect the object 102. In other embodiments, the sensor 
203 is another type of contactless sensor such as a pressure sensor, acoustic 
sensor, or electrostatic sensor. 

B. Distributed Control With Global Constraints 



20 Figure 2. Using the embedded microscopic sensors 203 and actuators 202, the 
controller 230 actively controls the motion of objects 1 02 such as paper traveling 
between the upper and lower levels of the transport assembly. For illustrative 
purposes, only the lower level 106 of the transport assembly is shown in Figure 



Figure 6 illustrates a detailed block diagram of the controller 230 shown in 
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6. Control of sensor 203 and actuators 202 embedded in the transport assembly 
102 is distributed among local computational agents 600 (i.e., local controllers), 
each of which is concerned with a limited aspect of a system goal of moving 
object along the transport assembly. The agents are grouped into localized 
neighborhoods of agents 620, between which, desired actuator responses are 
directly communicated, as indicated by arrows 622. Each localized neighborhood 
of agents 620 is defined by sensors and actuators that are located physically 
proximate to each other on the transport assembly. 

The agents 600 are coupled indirectly to a global controller 602 through 
an agent filter 604 and a potential field 606. The global controller 602 relies on 
simplified assumptions of an idealized system and limited aggregate operating 
characteristics of the transport assembly to produce an approximate specification 
of global constraint preferences. A simplified assumption of an idealized system 
is for example a system in which every sensor and actuator functions properly. 
The limited aggregate operating characteristics output from agent filter 604 is 
distilled from detailed sensor information output from agents 600. This 
approximate specification of global constraint preferences is delivered to the 
local agents through the potential field 606. As discussed in detail below, the 
local agents use the approximate specification of the global constraint 
preferences as well as detailed localized information to modify the behavior of 
actuators coupled thereto. The global constraint preferences provide a 
generalized guide to each agent of the system's behavior. In contrast, the 
localized information provides details of an agent's local operating environment 
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(e.g., displacement of the object from the surface of the transport assembly). As 
a result, each agent is able to pursue a generalized system goal while 
compensating for localized deviations (e.g., perturbations of the object on the 
transport assembly, or localized sensor and actuator failures). 

Advantageously, decomposition of the controller 230 into a global 
controller and local agents simplifies lines of communication between agents. 
This form of decomposition is appropriate for operating the controller 230 
because interactions between local agents 600 tend to be limited to agents 
coupled to sensors and actuators located spatially proximate to each other. 
Unlike purely distributed systems in which agents communicate directly with 
each other, the controller 230 minimizes inter-agent communications by limiting 
the degree of information (i.e., quantity and specificity) exchanged by the global 
controller and the agents. As a result, agents with control sensors and actuators 
that are not located spatially proximate to each other, do not directly 
communicate with each other. Additionally, organizing the controller 230 into 
agents and a global controller has the advantage of simplifying the development 
of each in either hardware or software because each control element is 
concerned with a simplified aspect of the entire problem. The global controller is 
concerned with achieving an "idealized" global goal while each local agent is 
concerned with achieving a detailed localized goal. 

More specifically, Figure 6 illustrates a block diagram of a cross section of 
the lower section 106 of the transport assembly 100. Embedded at the surface of 
the lower section 106 are multiple sensors 202 and actuators 203. Agents 600 
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are coupled to the sensors and actuators to receive and transmit information 

therefrom. The sensors 203 transmit discrete measurements that correspond to 

the instantaneous position of the object 102 on the transport assembly to the 

agents 600, as indicated by arrows 626. The actuators or air jets 202 receive 

5 commands in the form of specific actuator settings from the agents 600, as 
indicated by arrows 628. Different actuator settings apply different directional 
forces in the form of air to the object 102 on the transport assembly. Although 
Figure 6 shows each computational agent 604 coupled one sensor 203 and 
actuator 202, it will be appreciated by those skilled in the art that an actuator 

10 such as an air jet may include one or more channels of exiting or entering air and 
that a sensor may have one or more sensor elements. It will also be appreciated 
that each agent 600 can be coupled to one or more sensors and actuators to 
define a localized region of control 630. It will further be appreciated that the 
number of actuators need not equal the number of sensors in each localized 

15 region of control. 

Unlike other distributed control organizations, there exits a high density of 
sensors and actuators embedded in the transport assembly. In one embodiment, 
the lower section of transport assembly 106 has on the order of 0.1-4 sensors 
and/or actuators per square centimeter. In addition, unlike other distributed 
20 control systems, the actuators are positioned sufficiently proximate to each other 
that their output may be cross-coupled. For example, output from two 
neighboring air jets may cumulatively apply a force that is different than the sum 
of the forces applied independently. In such a case, each local control agent 
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requires some knowledge about its neighbors. To account for these cross- 
coupling effects, the agents 600 are organized into the local neighborhoods of 
agents 620 to minimize actuation effort required by each actuator to achieve the 
desired global system goal. The size of each neighborhood can either be fixed or 
5 defined adaptively and will depend on particular system in which they operate. 
Agents forming these local neighborhoods of agents 620 share their desired 
actuator response as indicated by arrow 622. 

Each computational agent 600 is an autonomous controller. That is, each 
agent acts independent of any other agent and the global controller to ascertain 
Q 10 how much force should be applied to its localized region of control. Data from its 
hi localized region of control 630, desired actuator responses from its local 

neighborhoods of agents 620, and values detected from the potential field 606 
are used by an agent to calculate a desired actuator response that is based 
upon a desired state and a current state of the object's position and velocity. 
15 Each agent responds to environmental changes that sensor and actuator pairs 
detect within a local operating time interval 608 that is on the order of 1-100 
milliseconds. During each local operating time interval, multiple agents operate 
to stabilize and propel one or more objects along the transport assembly. In the 
case of the transport assembly 100 shown in the Figures, sensors 203 and air 
20 jets 202 must be able to quickly ascertain the amount of force to apply to each 
object or paper 102 on the transport assembly within the local operating time 
interval to precisely move the object along the transport assembly. This 
organization of distributed control provides real time responses to local 
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environmental changes detected along the transport assembly because the 
agents have autonomous control over the actuators to which they are coupled. 

The global controller 602 communicates with the agents over a global 
operating time interval 610. The global operating time interval 610 is slower by, 
for example, one or more orders of magnitude than the local operating time 
interval 608. The reason for the difference is that the computational operations 
performed by the global controller 602 are more complex than the local agents 
600. Unlike the local agents which are concerned with only localized regions of 
control 630, the global controller evaluates generalized positional and directional 
information of objects on the transport assembly to determine whether the 
system goal is being achieved. Consequently, the global controller is history- 
sensitive and must maintain detailed state information while the local agents 
maintain little or no state information. In one embodiment, the system goal, 
which defines the global constraint preferences, may be specified using a 
desired trajectory of the object on the transport assembly. In one instance, the 
desired trajectory defines how the object moves on the transport assembly as a 
function of time. To simplify the computational task of the global controller 602, 
detailed sensor information transmitted from agents 600, as indicated by arrow 
632, is filtered by agent filter 604. The agent filter 604 averages detailed sensor 
information over the global operating interval 610. As a result, the global 
controller 602 senses aggregate (or generalized) operating characteristics and 
not detailed characteristics of the entire configuration of local agents 600. 
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The global controller 602 computes an approximate specification of global 

constraint preferences using the generalized positional and directional 

information from filter agent 604 to generate a potential field 606. The computed 

global constraint preferences are delivered to agents 600 through the potential 

5 field 606, as indicated by arrow 638. The magnitude of the potential field varies 
depending on the particular location of the transport assembly the agents are 
mapped or physically located. Advantageously, the potential field simplifies 
communication between the global controller and the assembly of agents 600 
because the global controller does not have to communicate directly with any 

10 one agent but instead delivers information generally to all agents. 

In one embodiment, the potential field 606 is a set of values f 1f f 2 , f3, etc. 
that map to locations where the agents 600 or their sensors and actuators are 
located. In an alternate embodiment, the range of values is substituted with a set 
of difference values (e.g., U - f 2 ).The range of values and the range of 

15 differences values change gradually from one value to the next. This gradual 
change minimizes abrupt transitions in global specification of constraint 
preferences, thereby allowing simpler global control based on limited aggregate 
operating characteristics. Local forces, however, could change abruptly due to 
actuator or sensor failures, for example. In yet another embodiment, a limited 

20 number of regions of the potential field are defined to have values, and any value 
in any intervening region is interpolated by the agents. Depending on where an 
agent is located, or mapped, the potential field defines what value the agent 
detects. For example, the agents shown in Figure 6 detect a value of fn for the 
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potential field 606 as indicated by arrow 638. In one embodiment, agents in 
similarly situated neighborhoods 620 are mapped to a region of the potential field 
having a similar value (e.g., fi). Alternatively, each agent is mapped to a unique 
region of the potential field that is independent from any other agent. 



system's global constraint preferences for a generalized region of the transport 
assembly. These global constraint preferences provide instructions that define 
how an agent should behave generally. In one embodiment, the potential field 
values are constant and therefore only communicate the system's global 

10 constraints once at system initialization. In another embodiment, the potential 
field values are updated over the global operating interval 610. In this alternate 
embodiment, aggregate operating characteristics received from agent filter 604 
are evaluated by global controller 602 using simplified assumptions of the 
operation of the transport assembly before updating the values of the potential 

15 field 606 over the global operating time interval 61 0. 



electrical forces. For example in the transport assepnbly, each agent could detect 
values of global constraint preferences from a >wire carrying a range of voltage 
potentials. Alternatively, each agent could detect regional air pressure settings of 
20 the transport assembly. In this alternate' embodiment, values of the global 
constraints are reflected regionally by/the pressure difference between low- 
pressure plenum 214 and high-pres/ure plenum 216. In another embodiment, 
global constraints could be conveyed using funding policies of computational 
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The value of the potential field 606 detected by an agent relates to the 




potential field 606 can be specified using either mechanical or 



-17- 



I^^No. EG365635536US ^jjf 



"Express I^B^o. EG365635536US , Patent Application 

Attorney Docket No. D/98093 

markets. More details of computational markets is disclosed in U.S. Patent 

Application Serial No. 08/BBB,BBfB (Attorney Docket No. D/98091). In yet 

another embodiment probabilistic/and randomized algorithms are used to define 

local agent behavior, and in /which global constraints are conveyed using 

probability values that are delivered to the collection of agents. In a further 

embodiment, the global controller delivers the values of the potential field 

digitally using a broadcast network or a shared memory storing a lookup table. 



Figure 7 is a flow diagranr/which sets forth the steps performed by an 
agenr during the local operating time interval 608. At step 700, the agent 
10 computes a local response to/sensor information received from sensors to which 
it is coupled. At step 702^ the local response is assigned to equal a desired 
response. The desired response is the desired correctional command sought to 
be issued to the actuaftor units to which the agent is coupled. At step 704, an 
agent detects a value of the potential field 606. The values of the potential field 
15 can be fixed at the/time system variables of the transport assembly are initialized 
at start up. Alternatively, the values of the global field can be adaptively modified 
as set forth in/U.S. Patent Application Serial No. 08/CCC,CCC (Attorney Docket 
No. D/9809^). 

Using this detected value of the potential field 606, the agent computes a 
20 global response at step 704. As set forth above, the magnitude of the potential 
field varies depending on the particular location of the transport assembly the 
agents are mapped or physically located. By detecting the magnitude of the 
potential field, an agent can ascertain a generalized goal of the global controller 
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in its particular region of the transport assembly. The generalized goal may, for 
example, be to move an object along the transport assembly at a particular 
velocity. Each operating actuator contributes to achieving this goal. The global 
controller receives aggregate operating characteristics of the transport assembly, 
but not the status of each actuator. That is, the global controller is unaware of 
how much each agent is contributing to achieving the generalized goal. 

At step 706, the agent tests whether the desired response (i.e., local 
response at this point) is approximately equal to the global response computed 
at step 704. In the event the global response is approximately equal to the 
desired response, then step 710 is performed; otherwise, step 708 is performed 
to reduce deviations from the approximate global control model of the system. At 
step 708, the desired response is modified to reduce the difference between the 
local response and the global response. Subsequently, at step 710, the desired 
response (whether modified or unmodified) is tested to determine whether it is 
approximately equal to local neighborhood responses. That is, at step 710, the 
agent compares its desired response with that of other agents in its localized 
neighborhood 620. If actuators and sensors coupled to neighborhood agents are 
all properly functioning, then step 714 is performed; otherwise, step 716 is 
performed to reduce deviations from desired responses in the localized 
neighborhood 620. At step 714, the desired response is modified to reduce the 
difference between it and the neighborhood response. Otherwise at step 716, 
the desired response is modified to compensate for malfunctioning neighbors 
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while minimizing the difference between the modified desired response and the 

neighborhood responses. 

At step 718, the set of actuators to which the agent is coupled is adjusted 
to reflect the desired response. The actuators controlled by each agent may be 

5 adjusted to one or more different settings. In the transport assembly 100 each 
setting could reflect different settings of the air valves (e.g., closed, Va open, Vz 
open, % open, and full open). At step 720, the agent waits for the local operating 
interval 608 to elapse before repeating step 700. In operation, the controller 230 
repeats these steps each time local sensor information is received by an agent, 

10 thereby creating a feedback loop in which localized positional information is 
received and a correctional command is issued over each local operating time 
interval 608. However, since the global operating interval may be one or more 
orders of magnitude slower than the local operating interval, the rate at which the 
potential field is updated depends on the global operating time interval 610. As a 

15 result, several iterations of step 904 may be performed before the potential field 
is changed by the global controller 602. 

Figures 8 and 9 illustrate cross sections of the lower section 106 of the 
transport assembly. Each Figure illustrates a different example of the controller 
230 in operation. In both Figures 8 and 9, the agents 600 grouped in the 
20 localized neighborhood of agents Ai work to achieve a global system goal, 
defined generally by potential field 606, of moving the object 102 at velocity vi 
along the lower level of the transport assembly. The velocity ^ is determined by 
looking up the local neighborhood of agents A) to which it was mapped in lookup 



-20- 



"Express IV^^o. EG365635536US W Patent Application 

Attorney Docket No. D/98093 

table 1000 illustrated in Figure 10. After each agent determines a global goal 
from the potential field, each agent computes its desired local goal viocai- A 
resulting velocity v age nt , which is the desired actuation force to be applied by the 
actuators coupled thereto, is defined generally as a function of both the global 
velocity v g i 0 bai and the local velocity viocai. The resulting velocity v age nt of an agent 
can be represented in one embodiment as a linear combination of the global 
actuator response (e.g., velocity v g i 0 bai) and the local actuator response (e.g., 
velocity Viocai), as illustrated by the following equation: 

Vacjent = Wi V g | 0 bal + W 2 Viocai, Where 

i"" i 

O 10 weights Wi and w 2 define how much value to assign the global response and the 
local response. These weight can either be fixed or adaptively determined. In the 
^ examples illustrated in Figures 9 and 10, the local velocity Viocai is defined as 

s difference velocity Aviocai, which can have a positive or a negative value. The 

o 

W resulting velocity v age nt in this example can therefore be represented by the 

v * 15 following equation: 



.2^ 



CD 



V ag ent = Vgiobal + AViocal- 

More specifically, Figure 8 illustrates an example of how the localized 
neighborhood of agents 620 compensate for a perturbation 802 in the object 102 
independent from the global controller 602. Because the global controller only 
20 detects the aggregate operating characteristics of the transport assembly, the 
global controller does not detect detailed localized behavior. In accordance with 
the invention, the individual agents 600 compensate for the perturbation 802 by 
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modifying the system goal of the global controller. As illustrated in Figure 8, 
agent 806 reduces the global goal with a local change in velocity Aviocai to move 
the object at a resulting velocity v age nt given by vi-Aviocai- In addition, agent 808 
modifies the system goal to speed the object 102 up by changing the global goal 
to move the object at a resulting velocity v age nt given by Vi+Aviocai. It will be 
appreciated by those skilled in the art that the resulting agent velocity v age nt will 
generally increase from Vi-Aviocai at agent 806 to at agent 812 and from v r 
Aviocai at agent 806 to Vi agent 810, and that the resulting velocity v age nt will 
generally decrease from Vi+Aviocai at agent 808 to Vi at agent 810 and from 
Vi+Aviocai at agent 808 to Vi at agent 814. These localized changes in velocity 

which are made independent of the global controller have the overall effect of 
smoothing out the perturbation 802. 

Figure 9 illustrates an example in which agents 600 that compensate for 
malfunctioning actuators in a localized neighborhood. In Figure 9, actuator 202 
of agent 906 is not operating. Consequently, agents 908 and 910 compensate 
for this loss of force by changing the global goal to move the object at a resulting 
velocity v agen t given by + Aviocai, thereby producing a force that approximates 
the global goal in a localized region of the transport assembly. The localized 
changes by agents 908 and 910 effectively mask localized failures from the 
global controller 602, thereby simplifying the functionality of the global controller. 
This example illustrates how the local agents make the actuators and sensors 
behave closer to the generalized set of global constraints relied upon by the 
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global controller in developing the potential field. In effect, the controller 230 

operates with local agents having only detailed information of behavior of other 

agents within their local neighborhood and the global controller having only an 

aggregate or blurry perspective of agent behavior. 

5 C. Summary 

The invention has been described with reference to a particular 
embodiment. Modifications and alterations will occur to others upon reading and 
understanding this specification taken together with the drawings. The 
embodiments are but examples, and various alternatives, modifications, 
10 variations or improvements may be made by those skilled in the art from this 
teaching which are intended to be encompassed by the following claims. 

hile the present invention ha£ been illustrated using a two level 
contrblfer 230, it will be appreciated by/those skilled in the art that the two level 
controller can be generalized to multiple levels. For example, the agents 600 
15 could be grouped into multi-hierarchical levels of control to define regions of 
control as described in detail in/U.S. Patent Application Serial No. 08/AAA,AAA 
(Attorney Docket No. D/9809D). Alternatively, multiple controllers 230 could be 
grouped into multi-hierarchical levels of control. It will also be appreciated that 
the controller 230 as defined herein can be used to stabilize materials as set 
20 forth in U.S. Patent Application Serial No. 08/BBB.BBB (Attorney Docket No. 
D/98091) or U.S. PateM Application Serial No. 08/CCC,CCC (Attorney Docket 
No. D/98092). In this/ alternate embodiment, the global controller changes the 



J0 



-23- 



"Express f^^Jo. EG365635536US Patent Application 



,0 



Attorney Docket No. D/98093 

potential fidld to encourage agents to compensate for parts of the structure that 
are under Stress. 

It will be appreciated that the controller 230 may be readily implemented 
in software using software development environments that provide portable 

5 source code that can be used on a variety of hardware platforms. Alternatively, 
the disclosed system may be implemented partially or fully in hardware using 
standard logic circuits. Whether software or hardware is used to implement the 
system varies depending on the speed and efficiency requirements of the system 
and also the particular function and the particular software or hardware systems 

10 and the particular microprocessor or microcomputer systems being utilized. 

In addition, the controller 230 may either be a physically distributed 
system in which each agent is operating on a separate processing unit. 
Alternatively, the controller may be implemented in a memory of a centralized 
processing unit having one or more processors. Because each agent does not 

15 have to be cognizant of whether it is operating on a physically distributed or 
centralized system, the software for implementing the controller can be 
implemented to run in either environment. In either embodiment, the system can 
be readily developed by those skilled in the applicable arts without undue 
experimentation from the functional description provided herein together with a 

20 general knowledge of the computer arts. 

It will be appreciated by those skilled in the art that actuators 202 can be 
used to move an object along the transport assembly with fluids other than air. 
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Also, will also be appreciated by those skilled in the art that the controller 230 

can be used to control other types of pneumatic actuators such as vacuum 

actuators. In addition, it will be appreciated that the controller can be used to 

control mechanical actuators. For example, controller 230 can be used to control 

mechanical rollers or a vacuum belt to move sheets of paper in an electronic 

printing machine. In another embodiment, not shown, the agents are coupled to 

sensor units that are physically offset from actuator units on the transport 

assembly. In this alternate embodiment, the agents are coupled to sensor units 

and actuator units which are not co-located immediately adjacent to each other. 

A more detailed description of the sensors and actuators forming a 
transport assembly is disclosed in U.S. Patent No. 5,634,636, which is 
incorporated herein by reference. For additional details, examples and 
background on smart matter, the following article is incorporated herein by 
reference: Carlson et al., "Controlling Agents in Smart Matter with Global 
Constraints," Proc. of the AAAI97 Workshop on Constraints and Agents, pp. 58- 
63, July 1997 (also on the internet at http://ic- 
www.arc.nasa.gov/ic/people/vgupta/publications/smartmatter-aaai97.ps). 
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